Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

BIGTOP-3928. Fix build failure of Hive due to unresolved transitive dependency on javax.el. #1102

Open
wants to merge 1 commit into
base: master
Choose a base branch
from
Open

BIGTOP-3928. Fix build failure of Hive due to unresolved transitive dependency on javax.el. #1102

wants to merge 1 commit into from

Conversation

iwasakims
Copy link
Member

https://issues.apache.org/jira/browse/BIGTOP-3928

./gradlew hive-pkg fails due to unresolved dependency on javax.el.

[ERROR] Failed to execute goal on project hive-hbase-handler: Could not resolve dependencies for project org.apache.hive:hive-hbase-handler:jar:3.1.3: Failed to collect dependencies at org.apache.hbase:hbase-server:jar:tests:2.4.13 -> org.glassfish.web:javax.servlet.jsp:jar:2.3.2 -> org.glassfish:javax.el:jar:3.0.1-b06-SNAPSHOT: Failed to read artifact descriptor for org.glassfish:javax.el:jar:3.0.1-b06-SNAPSHOT: Could not transfer artifact org.glassfish:javax.el:pom:3.0.1-b06-SNAPSHOT from/to jvnet-nexus-snapshots (https://maven.java.net/content/repositories/snapshots): Transfer failed for https://maven.java.net/content/repositories/snapshots/org/glassfish/javax.el/3.0.1-b06-SNAPSHOT/javax.el-3.0.1-b06-SNAPSHOT.pom: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target -> [Help 1]

Applying backport patch of HIVE-19579 fixed this.

@iwasakims
Copy link
Member Author

ran smoke-tests of hive on Rocky Linux 8 (x86_64).

@iwasakims iwasakims mentioned this pull request Apr 13, 2023
Merged
@guyuqi guyuqi mentioned this pull request Apr 17, 2023
Merged
@guyuqi
Copy link
Member

guyuqi commented Apr 19, 2023 •
edited
Loading

Thanks for working on it, @iwasakims
I verified the Haddop and Hive smoke tests on Centos-7 and Fedora-36 successfully (x86_64 / Arm64).

However, when testing on Ubuntu 22.04, the deployment of Hive failed due to dependency issues.

config_ubuntu-22.04.yaml :

...
components: [bigtop-utils, zookeeper,hdfs, yarn, mapreduce, hive]
enable_local_repo: true
smoke_test_components: [hdfs, yarn, mapreduce, hive]

./docker-hadoop.sh -d -C config_ubuntu-22.04.yaml -c 3 -s

Log:

Notice: /Stage[main]/Hadoop::Client/Package[hadoop-hdfs-fuse]/ensure: created
Notice: /Stage[main]/Hadoop::Client/Package[libhdfs0-dev]/ensure: created
Error: Could not update: Execution of '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install hive' returned 100: Reading package lists...
Building dependency tree...
Reading state information...
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
 hive : Depends: python but it is not installable
E: Unable to correct problems, you have held broken packages.
Error: /Stage[main]/Hadoop_hive::Client_package/Package[hive]/ensure: change from 'purged' to 'latest' failed: Could not update: Execution of '/usr/bin/apt-get -q -y -o DPkg::Options::=--force-confold install hive' returned 100: Reading package lists...
Building dependency tree...
Reading state information...
Some packages could not be installed. This may mean that you have
requested an impossible situation or if you are using the unstable
distribution that some required packages have not yet been created
or been moved out of Incoming.
The following information may help to resolve the situation:

The following packages have unmet dependencies:
 hive : Depends: python but it is not installable
E: Unable to correct problems, you have held broken packages.

@iwasakims
Copy link
Member Author

However, when testing on Ubuntu 22.04, the deployment of Hive failed due to dependency issues.

@guyuqi It can be reproduced regardless of the patch. I filed BIGTOP-3930. All packages depending on python should be affected. Let's resolve BIGTOP-3920 and this first.

@iwasakims
Copy link
Member Author

The deb packages worked on Debian 11 at least.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@iwasakims @guyuqi